Hé: Calligraphy as a Musical Interface

The project Hé(和, harmony) is a sound installation that enables a user to play music by writing calligraphy. We developed a system where calligraphic symbols can be detected and converted to a sound composed of pitch, pitch length, and volume though MIDI and serial communication. The Hé sound installation involves a micro-controller, photocells, and multiplexers. A DC motor controls the speed of a spooled paper roll that is capable of setting the music tempo. This paper presents the design concept and implementation of Hé. We discuss the major research issues such as using photocells for detecting components of calligraphy like thickness and location. Hardware and software details are also discussed. Finally, we explore the potential for further extending musical and visual experience through this project’s applications and outcomes.